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COPYRIGHT NOTICE 

1 0 A portion of the disclosure of this patent document contains 

material which is subject to copyright protection. The copyright 
owner has no objection to the facsimile reproduction by anyone of 
the patent document or the patent disclosure, as it appears in the 
Patent and Trademark Office patent file or records, but otherwise 

1 5 reserves all copyright rights whatsoever. 



Claim of Priority: 

[0001] This application claims the benefitof U.S. Provisional Application 
"SYSTEM AND METHOD FOR MEMORY LEAK DETECTION IN A VIRTUAL 
20 MACHINE ENVIRONMENT", Serial No. 60/435,487; filed December20, 2002, 
and incorporated herein by reference. 

Field of the Invention: 

[0002] The invention is generally related to virtual machine and run-time 
25 environments, and particularly to a system and method for detecting memory 
leaks in a garbage collected environment. 



Background of the Invention: 

[0003] In an application server or run-time environment which includes a 
30 virtual machine, for example the Java Virtual Machine from Sun Microsystems or 
the J Rockit Virtual Machine from Bea Systems, Inc., resources are constantly 
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being created and used to service client and server requests. The typical virtual 
machine (VM) environment exists on a server that includes an operating system 
and memory space. As the VM executes, servicing client requests and running 
applications, it creates object instances in the memory of the VM or server. As 
5 the system operates this memory space is continuously used up with new objects 
and other resources. The typical VM environment includes a garbage collection 
mechanism that is used to clean up the memory space and to remove those 
resources that are no longer needed . Most common garbage collection methods 
operate on the basis of automatically freeing up resources that are no longer 

1 0 used, i.e., that include objects which are no longer referred to by other objects. 
However, a common problem with all existing garbage collection mechanisms 
is that of memory leakage. During the development of a typical software 
application, objects may be specified by the developer that may unknowingly 
point to other objects. During run-time, this object may then point to another 

1 5 object which is no longer needed. If an object that is no longer needed and yet 
still exists in memory space because of such invalid requests or pointers, this is 
considered a memory leak and is undesirable. Because the object is never 
freed up, the memory space it occupies cannot be used by other resources. This 
is a particular problem when objects are continuously created during run-time but 

20 are never freed up, so that eventually the entire memory space of the virtual 
machine fills up and the machine or computer typically needs to be restarted 
[0004] The traditional approach to detecting and analyzing potential 
memory leaks during the software development process is to create an object 
display or object map for the developer that illustrates all of the preferred objects 

25 in the memory space, and then highlights or otherwise displays to the developer 
those objects that may represent potential memory leaks. The problem with this 
method is that it only gives a high level view of the object map, and provides very 
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little useful information to the developer to accurately determine large scale 
memory leaks and find the responsible object or objects. Since the vast number 
of objects represented on the display tend to overwhelm the important 
information, i.e. , which objects are prone to creating memory leaks, it is doubtful 
5 that this large scale object display is of much use to the developer. 

[0005] Besides this traditional method of creating object maps, little else 
has been done in the software development field for creating tools that allow a 
virtual machine application developer to accurately access their application for 
potential memory leaks. Any new technique that would assist the developer in 
10 detecting such memory leaks would provide a significant advantage to the 
software developer, and would result in cleaner applications that minimize the 
need to restart the virtual machine on such a regular basis. 

Summary of the Invention: 

1 5 [0006] The invention provides a system and method fordetecting memory 
leaks in a garbage collected environment. In particular, the invention provides a 
mechanism by which objects in the memory space of a virtual machine are 
analyzed as to whether they are "warm" or "cold", i.e., how long they have 
persisted in memory without being accessed or referenced by another object. 

20 Following this analysis, the objects are clustered into groups or clusters of warm 
or cold objects, and any links from warm clusters to cold clusters are determined. 
This information is then provided to the software developer for use in detecting 
and analyzing potential memory leaks. 

[0007] In accordance with one embodiment, the invention comprises a 
25 system for determining potential memory leaks in a run-time environment, said 
run-time environment including a virtual machine and a memory space for storing 
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objects, comprising: an object temperature analyzer that determines the status 
of warm objects and cold objects in said memory, and the links between said 
warm and cold objects; and, a report mechanism that reports information about 
said links, for use in determining potential memory leaks. 
5 [0008] In accordance with another embodiment, the invention comprises 
a method for use in determining potential memory leaks in a run-time 
environment, said run-time environment including a virtual machine and a 
memory space for storing objects, comprising: creating objects in the memory 
of a run-time environment; stamping each object with a time stamp when created; 
1 0 updating the time stamp as each object is accessed or referenced; after a time 
Tcheck marking each object as being either warm or cold; clustering warm objects 
together to form warm clusters and cold objects together to form cold clusters; 
and, displaying an object map showing links between warm clusters and cold 
clusters. 

15 [0009] Additional embodiments are described herein. The above 
examples are not intended to be exhaustive or to limit the invention to the precise 
forms disclosed. It is intended that the scope of the invention be defined by the 
following claims and their equivalence. 

20 Brief Description of the Figures: 

[0010] Figure 1 shows a flowchart of a method in accordance with an 
embodiment of the invention that can be used to display an object map. 
[001 1] Figure 2 illustrates a schematic of a system in accordance with an 
embodiment of the invention that can be used to analyze potential memory leaks. 
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[001 2] Figure 3 illustrates a schematic of a process in accordance with 
an embodiment of the invention in which objects are marked as warm or cold 
objects and then clustered to provide memory leak information. 
[0013] Figure 4 shows a flowchart of a process in accordance with an 
5 embodiment of the invention that is used to cluster warm and cold objects and 
provide memory leak information. 

[0014] Figure 5 illustrates a object map and display in accordance with 
an embodiment of the invention. 

10 Detailed Description: 

[0015] As described herein, an embodiment of the present invention 
provides a system and method for detecting memory leaks in a garbage 
collected environment. In particular, the invention provides a mechanism by 
which objects in the memory space of a virtual machine are analyzed as to 

15 whether they are "warm" or "cold", i.e., how long they have persisted in memory 
without being accessed or referenced by another object. Following this analysis, 
the objects are clustered into groups or clusters of warm or cold objects, and any 
links from warm clusters to cold clusters are determined. This information is then 
provided to the software developer for use in detecting and analyzing potential 

20 memory leaks. 

[0016] Figure 1 shows a flowchart of a process in accordance with an 
embodiment of the invention. As shown in Figure 1 , the process begins in step 
2 with stamping each object with a time stamp. This can only be done in a virtual 
machine environment, since that is where the objects are placed into memory. 

25 In accordance with this embodiment of the invention each object header must 
include an extra field that is used to represent the time stamp. In step 4, every 
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time the object is accessed i.e., referenced by another object, the time stamp 
within the header forthat object is updated with the new time stamp information. 
In step 6, after a particular time, all of the objects are analyzed for potential 
memory leaks. Objects that have been accessed within some reasonable 
5 measure of time are marked as "warm" objects, while objects that have not been 
accessed within that time frame are marked as "cold" objects. It will be evident 
that the length of time used to determine whether an object should be marked as 
being warm or cold may be varied to suit the particular implementation, system 
environment, or needs of the developer. Embodiments of the invention may 

1 0 include controls for allowing the developer to fine tune the distinction between 
warm and cold objects. In step 8, all of the warm objects which are pointing to 
each other are clustered together in a warm cluster, and similarly all of the cold 
objects that are pointing together are clustered together to form a cold cluster. 
This clustering mechanism greatly assists the software developer in detecting 

15 potential memory leaks. Whereas in the traditional methods, objects are 
checked for memory leaks simply on the basis of each object, the feature of the 
present invention in being able to cluster cold objects and warm objects together 
allows the developer to focus on those leaks that are more substantial. In step 
10, an object map is displayed graphically showing the programmer or software 

20 developer the links between the cold clusters and the warm clusters, and also 
informing the developer which particularfield in which particular warm object is 
referencing the cold cluster. This gives the developer a powerful graphical view 
of their object memory usage, and allows them to focus on those objects that 
present the most potential for memory leak. 

25 [001 7] In some embodiments, the number of clusters can be reduced by 
displaying to the developer only those clusters that occupy more than a particular 
amount of memory space, e.g. x bytes of memory. The actual implementation 
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details of this may vary, and may be left to the developer to fine-tune for their 
particular needs or preferences. 

[001 8] Figure 2 illustrates a system in accordance with an embodiment 
of the invention that can be used by a software developer to detect potential 
5 memory leaks in a virtual machine or run-time environment. As shown in Figure 
2, the system 20 typically includes a server 22 that is accessed by a client device 
including a display 24. I n a typical development environment, the display 24 and 
server device 22 may be included within the same physical machine. As shown 
in the architecture, the server typically includes hardware components 26, 

1 0 operating system 28, and a run-time environment or virtual machine (VM) 30 such 
as the Java Virtual Machine, JRockitVM, or anothertype of virtual machine. The 
VM also includes, or has access to, a memory space 32 which includes the 
objects necessary for the application 34. In accordance with an embodiment of 
the invention, the VM includes a mechanism, in this case indicated as an object 

15 temperature analyzer and clusterer 36, which is used by the system to determine 
the temperature and potential memory leakage of objects 34 within memory 
space 32 of the VM 30. This information is then used to create an object map 
38 on the developer's display 24, that illustrates the objects in memory and their 
potential for memory leakage. 

20 [0019] Figure 3 illustrates an overview of a process in accordance with 
an embodiment of the invention in which objects in memory are clustered by the 
object temperature analyzer and clustererto provide information about potential 
memory leaks to the developer. As shown in Figure 3, objects 34 occupy the 
memory space 32 of the virtual machine. While in the example shown in Figure 

25 3, objects are actually moved within the memory space of the computer during 
a garbage collection process, it will be evident to one skilled in the art that the 
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clustering process need not actually move the objects within memory but may 
merely determine which objects belong to which clusters and then use this 
information to create the object map that appears on the software developer's 
display. Figure 3 is thus shown for illustrative purposes but does not necessarily 
5 represent the actual positioning or movement of objects within memory space. 
[0020] As shown in Figure 3, objects A 36, B 48, C 54, D 60, and E 66, 
are created in memory 32. Each object, for example object A 36, includes a 
number of fields 38, 40, 42. In accordance with an embodiment of the invention, 
the object will also include a time stamp 44 that is used to store a value indicating 

1 0 the time that the object was last accessed by the system or by another object. 
Pointerfield 46 allows objects to reference other objects, orto be referenced by 
other objects. As shown in Figure 3, as the objects are created they may 
reference other objects, for example in Figure 3 object C references object A by 
pointer 72 while object D references object C by pointer 76. Similarly, pointers 

15 70, 74, and 78 are used to reference other objects. After a particular time T has 
elapsed, which depending on the implementation may range from several 
milliseconds to many tens or hundreds of seconds, an analysis is performed of 
the objects currently in memory. The time stamp for each object is checked 
against the current system time, and those objects that have a time stamp older 

20 than a particular period of time are marked as cold objects. All otherobjects, i.e. 
those that have a time stamp more recent than a specified cut-off time are 
marked as warm objects. Once marked, cold objects are clustered together, as 
are hot objects. Links between hot clusters and cold clusters for example pointer 
76 in Figure 3, are particularly important since they represent a linkfrom a warm 

25 object to a cold object and are thus a potential memory link. This information is 
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provided to the software developer as part of the object map, and the fields 
responsible for this pointer will be indicated. 

[0021 ] Figure 4 illustrates a flowchart in accordance with an embodiment 
of the invention that illustrates the process used by the system to display an 
5 object map, including displaying links between warm and cold clusters. As 
shown in Figure 4, in step 90 the process begins, either automatically at a 
particular point in time, or at the request of the software developer, for example 
to take a snap-shot of the current state of the system. In step 92 the memory 
space is populated with objects as the run-time environment executes. For each 

1 0 object, in step 94, the object header includes a time stamp field which is initially 
set as T init , i.e. , the time at which the object is initialized. In step 96, as the object 
is used, or referenced by a subsequent object, the time stamp field is updated 
with the last access time T access for this particular object. The system is then 
allowed to run for a check time T check , in step 98. This process is repeated in 

1 5 step 1 00 for each object in memory. I n step 1 02 , the system receives a request, 
i.e., either an automatic request or a determined request by the operator, to view 
the object display or object map. In step 1 04, the time stamp is checked for each 
object in memory. For each object in memory, in step 1 06 the state of the object 
is determined as to whether the object is warm or cold, and marked accordingly. 

20 If T check - T access is greater than a specified time T, jmjt , then the object may be 
considered cold. This process is repeated for each object in memory, in step 
108. Following the preceding steps all objects in memory will now be indicated 
as being warm orcold. In step 110, all cold objects that pointto one another are 
clustered together, while in step 112 the clustering process is repeated for all 

25 warm objects. In step 114, the system determines these warm object clusters 
that point to cold object clusters. These are of particular importance to the 
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software developer since they represent large potential memory leaks. In step 
116, the fields in the culprit objects are introspected to determine which of the 
fields in the warm objects point to which of the fields in the cold objects. In step 
118 the object map for the current situation is displayed on the user's display 
5 including links between the warm clusters and cold clusters, or between warm 
objects and cold objects. The information may also be exported to other 
applications for use during the software development process. 
[0022] Figure 5 illustrates an example of an object map in accordance 
with an embodiment of the invention. As shown in Figure 5, the operator's 
1 0 display 24 is used to display an object map 38, upon which object clusters are 
displayed with those clusters that are warm and which point to cold clusters 
clearly indicated on the object map. The user may then find out additional 
information about the culprit objects modify the software code if necessary, and 
re-run the analysis to assist in the software development process. 

15 

[0023] The present invention may be conveniently implemented using a 
conventional general purpose or a specialized digital computer or 
microprocessor programmed according to the teachings of the present 
disclosure. Appropriate software coding can readily be prepared by skilled 
20 programmers based on the teachings of the present disclosure, as will be 
apparent to those skilled in the software art. 

[0024] In some embodiments, the present invention includes a computer 
program product which is a storage medium (media) having instructions stored 
thereon/in which can be used to program a computer to perform any of the 
25 processes of the present invention. The storage medium can include, but is not 
limited to, any type of disk including floppy disks, optical discs, DVD, CD-ROMs, 
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microdrive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, 
DRAMs, VRAMs, flash memory devices, magnetic or optical cards, nanosystems 
(including molecular memory ICs), or any type of media or device suitable for 
storing instructions and/or data. 
5 [0025] The foregoing description of the present invention has been 
provided for the purposes of illustration and description. It is not intended to be 
exhaustive or to limit the invention to the precise forms disclosed. Many 
modifications and variations will be apparent to the practitioner skilled in the art. 
Particularly, while the embodiments of the system and methods described above 

10 are described in the context of a WebLogic server, and a JRockit virtual 
machine, it will be evident that the system and methods may be used with other 
types of application servers, runtime systems, and virtual machines, including 
other types of JVMs. The embodiments were chosen and described in orderto 
best explain the principles of the invention and its practical application, thereby 

15 enabling others skilled in the art to understand the invention for various 
embodiments and with various modifications that are suited to the particular use 
contemplated. It is intended that the scope of the invention be defined by the 
following claims and their equivalence. 
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